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Abstract 

In this article we study a continuous Primal-Dual method proposed 
by Appleton and Talbot and generalize it to other problems in image 
processing. We interpret it as an Arrow- Hurwicz method which leads 
to a better description of the system of PDEs obtained. We show 
existence and uniqueness of solutions and get a convergence result 
for the denoising problem. Our analysis also yields new a posteriori 
estimates. 
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1 Introduction 

In imaging, duality has been recognized as a fundamental ingredient for de- 
signing numerical schemes solving variational problems involving a total vari- 
ation term. Primal-Dual methods were introduced in the field by Chan, 
Golub and Mulct in [12]. Afterwards, Chan and Zhu [20] proposed to rewrite 
the discrete minimization problem as a min-max and solve it using an Arrow- 
Hurwicz [5] algorithm which is a gradient ascent in one direction and a gra- 
dient descent in the other. Just as for the simple gradient descent, one can 
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think of extending this method to the continuous framework. This is in fact 
what does the algorithm previously proposed by Appleton and Talbot in |1] 
derived by analogy with discrete graph cuts techniques. The first to notice 
the link between their method and Primal-Dual schemes were ChamboUe and 
al. in m. 

Besides its intrinsic theoretical interest, considering the continuous frame- 
work has also pratical motivations. Indeed, as illustrated by Appleton and 
Talbot in |3], this approach leads to higher quality results compared with 
fully discrete schemes such as those proposed by Chan and Zhu. We will 
numerically illustrate this in the final part of this paper. 

This paper proposes to study the continuous Primal-Dual algorithm fol- 
lowing the philosophy of the work done for the gradient flow by Caselles 
and its collaborators (see the book of Andreu and al. [2] and the refer- 
ences therein). We give a rigorous definition of the system of PDEs which 
is obtained and show existence and uniqueness of a solution to the Cauchy 
problem. We prove strong convergence to the minimizer for the Rudin- 
Osher-Fatemi model and derive some a posteriori estimates. As a byproduct 
of our analysis we also obtain a posteriori estimates for the numerical scheme 
proposed by Chan and Zhu. 



1.1 Presentation of the problem 

Many problems in image processing can be seen as minimizing in BV fl 
an energy of the form 

J{u)= [ \Du\+G{u)+ I \u-^\ (1) 

The notation / \Du\ stands for the total variation of the function u and 
Jn 

is rigourously defined in Definition 13. 1[ We assume that is a bounded 
Lipschitz open set of Mf^ (in applications for image processing, usually d = 2 
or d = 3) and that OQd is a subset of dQ. The function ip being given in 

(9^2/3 ), the term / |n — y?! is a Dirichlet condition on d^lo- We call OUn 
Jdno 

the complement of dQ^ in dQ and assume that G is convex and continuous 
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in LP' with 

G{u) < C(l + \u\l) with 1 < p < +00 

In this paper we note \u\2 the norm of u. According to Giaquinta and 
al. |16| we have, 

Proposition 1.1. The functional J is convex and lower-semi-continuous 
(Isc) in . 

In the following, we also assume that J attains its minimum in BV fl L^. 
This is for example true if G satisfies some coercivity hypothesis or if G is 
non negative. 

Two fundamental applications of our method are image denoising via to- 
tal variation regularization and segmentation with geodesic active contours. 

In the first problem, one starts with a corrupted image f = u + n and 
wants to find the clean image u. Rudin, Osher and Fatemi proposed to look 
for an approximation of u by minimizing 

/ \Du\ + ^ !{u-ff 
Jq ^ Jn 

This corresponds to G{u) = j Jq{u — f Y and d^lo = in ([1]). For a compre- 
hensive introduction to this subject, we refer to the lecture notes of Cham- 
boUe and al. [8]. Figure [1] shows the result of denoising using the algorithm 
of Chan and Zhu. 




Figure 1: Denoising using the ROF model 
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The issue in the second problem is to extract automatically the boundaries 
of an object within an image. We suppose that we are given two subsets S 
and T of dQ such that S lies inside the object that we want to segment and T 
lies outside. Caselles and al. proposed in [T] to associate a positive function 
g to the image in a way that g is high where the gradient of the image is low 
and vice versa. The object is then segmented by minimizing 



mm 

Eds, E'^dt 



g{s)ds (2) 

dE 



In order to simplify the notations, we will only deal with g = 1 in the 
following. It is however straightforward to extend our discussion to general 
(continuous) g. The energy we want to minimize is thus \Dxe\- This 
functional is non convex but by the coarea formula (see Ambrosio-Fusco- 
Pallara [I]), it can be relaxed to functions u G [0, 1]. 
Let (f = 1 on S and ip = on T. Letting dQo = S U T, and / be a 
function, our problem can be seen as a special case of the prescribed mean 
curvature problem (in our original segmentation problem, / = 0), 

inf / \Du\+ [ fu (3) 
Jn Jn 

u=ip in oiljj 

If u is a solution of ([3]), a minimizer of ([2]) is then given by any superlevel 
of u, namely E = {u > s} for any s g]0, 1[. This convexification argument 
is somewhat classical but more details can be found in the lecture notes [8] 
Section 3.2.2. 

It is however well known that in general the infimum is not attained because 
of the lack of compactness for the boundary conditions in BV. Following 
the ideas of Giaquinta and al. we have to relax the boundary conditions 
by adding a Dirichlet term Jqq^ \u — ip\ to the functional. We also have to 
deal with the hard constraint, < n < L This last issue will be discussed 
afterwards but it brings some mathematical difficulties that we were not able 
to solve. Fortunately, our problem is equivalent (see [S]) to the minimization 
of the unsconstrained problem 



J(u)= inf / \Du\+ / \u-ip\+ r\u\+ / f~\l-u\ 
Here /"*" = max(/, 0) and /~ = max(— /, 0). 

We give in Figure [2] the result of this segmentation on yeasts. The small 
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square is the set 5* and the set T is taken to be the image boundary. The 
study of this problem was in fact our first motivation for this work. 




Figure 2: Yeast segmentation 



1.2 Idea of the Primal-Dual method 

Formally, the idea behind the Primal-Dual method is using the definition of 
I -Dm I (see Definition 13. ip in order to write J as 

J{u) = sup K{u,^) 

€eci(n) 

I5|oo<l 

Where K{u,^) = — /j^Mdiv(^) + fg^^ \u — ip\ + G{u). Then, finding a 
minimum of J is equivalent to finding a saddle point of K. This is done by 
a gradient descent in u and a gradient ascent in ^. 

Let /b(o.i)(0 be the indicator function of the unit ball in (it takes the 
value if |^|oo < 1 and +oo otherwise) and d denotes the subdifferential (see 
Ekeland-Temam |14| for the definition ). As 

K(n,0 = - / udiv(0+ / |n-<^|+G'(n)-/B(o,i)(0 

we have VuK ~ — div^ + dG{u) and V^A' ~ Du — 9/^(0,1) (0- We are thus 
led to solve the system of PDEs: 

' dtu = diviO - dG{u) 

< dt^ = Du-dlBio,i){0 (4) 
+ boundary conditions 
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This system is almost the one proposed by Appleton and Talbot in [1] for 
the segmentation problem. 



Let us remark that, at least formally, the differential operator 
A{u,^) = ( n^^^'^Q^r^^^^L ) verifies by Green's formula and the mono- 



-Du + dlBio,i)iO . 
tonicity of the subdifferential (see Proposition I2.3p . 

{A{u,0, KO) = {dG{u),u) + (<9/b(o,i)(0,0 > 



which means that A is monotone (see Definition | 
In the next section we recall some facts about the theory of maximal mono- 
tone operators and its applications for finding saddle points. In the last 
section we use it to give a rigourous meaning to the hyperbolic system (jlj) 
together with existence and uniqueness of solutions of the Cauchy problem. 



2 Maximal Monotone Operators 

Following Brezis [H], we present briefly in the first part of this section the 
theory of maximal monotone operators. In the second part we show how this 
theory sheds light on the general Arrow-Hurwicz method. We mainly give 
results found in Rockafellar's paper |19) . 



2.1 Definitions and first properties of maximal mono- 
tone operators 

Definition 2.1. Let X he an Hilbert space. An operator is a multivaluated 
mapping A from X into V{X). We call D{A) = {x E X / A{x) ^ 0} the 
domain of A and R{A) = \^ A{x) its range. We identify A and its graph in 

X xX. 

Definition 2.2. An operator A is monotone if : 

Vxi, X2 e D{A), {A{xi) - A{x2),xi - X2) > 
or more precisely if for all xl G A{xi) and G A{x2), 

(x* — X2, Xi — X2) > 
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It is maximal monotone if it is maximal in the set of monotone operators. 
The maximality is to be understood in the sense of graph inclusion. 

One of the essential results for us is the maximal monotonicity of the 
subgradient for convex functions. 

Proposition 2.3. [6] Let if be a proper lower- semi- continuous convex func- 
tion on X then dip is a maximal monotone operator. 

Before stating the main theorem of this theory, namely the existence of 
solutions of the Cauchy problem —u' G A{u{t)) we need one last definition. 

Definition 2.4. Let A be maximal monotone. For x G D{A) we call A°{x) 
the projection of on A{x) (it exists since A{x) is closed and convex, see 
Brezis ^ p. 20). 

We now turn to the theorem. 

Theorem 2.5. |6] Let A be maximal monotone then for alluo G D{A), there 
exists a unique function u{t) from [0, +oo[ into X such that 

• u{t) G D{A) for allt>0 

• u{t) is Lipschitz continous on [0, +oo[, i.e u' G L°°(0,+oo;X) (in the 
sense of distributions) and 

I«1l-(0,+oo;X) < l^°(Wo)| 

• —u'(t) G A{u(t)) for almost every t 

• m(0) = Mo 

Moreover u verifies, 

• u has a right derivative for every t G [0, +oo[ and — — G A°{u(t)) 

• the function t — )■ A°{u{t)) is right continuous andt — )■ is non 
increasing 

• if u and u are two solutions then \u{t) — u{t)\ < |'u(0) — 'u(0)| 
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2.2 Application to Arrow-Hurwicz methods 

Let us now see how this theory can be apphed for tracking saddle points. As 
mentioned before, we follow here [19]. We start with some definitions. 

Definition 2.6. Let X = Y (B Z where Y and Z are two Hilbert spaces. A 
proper saddle function on X is a function K such that : 

• for all y & Y , the function K{y, ■) is convex 

• for all z E Z , the function K{-, z) is concave 

• there exists x = {y, z) such that K{y, z') < +oo for all z' E Z and 
K{y', z) > — oo for all y' G Y . The set of x for which it holds, is called 
the effective domain of K and is noted domK. 

Definition 2.7. A point (y, z) E X is called a saddle point of K if 



We then have, 

Proposition 2.8. A point {y, z) is a saddle point of a saddle function K , if 
and only if 



The proof of this proposition is easy and can be found in Rockafellar's 
book [H] p.380. 

The next theorem shows that the Arrow-Hurwicz method always provides 
a monotone operator. 

Theorem 2.9. p3] Let K he a proper saddle function. For x = {y, z) let 



Then T is a monotone operator with D(T) C domi^. 

We can now characterize the saddle points of K using the operator T. 

Proposition 2.10. jl^ Let K be a proper saddle function then a point x is 
a saddle point of K if and only if E T{x). 



K{y,z')<K{y,z)<K{y\z) 



My' e r, \/z e z 





y* is a subgradient of K{-, z) in y 
z* is a subgradient of — K{y, ■) in z 
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Remark . This property is to be compared with the minimality condition 
G df{x) for convex functions f. 

The next theorem shows that for regular enough saddle functions, the 
corresponding operator T is maximal. 

Theorem 2.11. |19) Let K be a proper saddle function on X . Suppose that 
K is Isc in y and upper- semi- continuous in z then T is maximal monotone. 

Proof. We just sketch the proof because it will inspire us in the following. 
The idea is to use the equivalent theorem for convex functions. For this we 
"invert" the operator T in the second variable. Let 

H{y, z*) = sup {z\ z) + K{y, z) 

The proof is then based on the following lemma : 
Lemma 2.12. H is a convex Isc function on X and 

{y*,z*)eny,z)^{y*,z)edH{y,z*) 

It is then not too hard to prove that T is maximal. 

□ 



3 Study of the Primal-Dual Method 

In this section, unless otherly stated, everything holds for general functionals 
J of the type 

Before starting the study of the Primal-Dual method, let us remind some 
facts about functions with bounded variation and pairings between measures 
and bounded functions. 

Definition 3.1. Let BV{Q) be the space of functions u in for which 

I \Du\ := sup / wdiv^ < +00 

IS|oc<l 

With the norm \u\bv = Jq \Du\ + \u\li it is a Banach space. We note the 
functional space BV"^ = BV{^) fl L^. 
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Proposition 3.2. Let u G L^{VL) then u G BV{VL) if and only if its distribu- 
tional derivative Du is a finite Radon measure. Moreover the total variation 

of Du is equal to j \Du\. 



n 



More informations about functions with bounded variation, can be found 
in the books [T] or |17| . 

Following Anzellotti |2], we define J^[C,,Du] which has to be understood as 
C, ■ Du, for functions u with bounded variation and bounded functions ^ 
with divergence in L^. 

Definition 3.3. • Let = ^ (L°°(fi))'^/ div^ G L'^{n)}. 
• For {u, G BV^ X X"^ we define the distribution Du] by 

{[^,Du],^) = - [ n<^div(0- / ne-V^ W^eC^{n) 
Jn Jn 

Tiieorem 3.4. [3] The distribution Du] is a bounded Radon measure on 
Q and if v is the outward unit normal to Q, we have Green's formula, 

[ [^,Du] = - [ wdiv(0+ / {^■iy)u 
Jn Jn Jan 

We now prove a useful technical lemma. 
Proposition 3.5. Let u G BV{Vl) then 



I \Du\ = sup / [^,Du] 
Jn £GA-2 Jn 



l€|oo<l 



Proof. By the definition of the total variation, 

/ \Du\ < sup / [^,Du] 
Jn (ex2 Jn 



l€|oo<l 



We thus only have to prove the opposite inequality. 

Let C{Q) be the space of continuous functions on Q then by Proposition 1.47 
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p.41 of the book [I], 



Du I = sup / C, ■ Du 

l?|oo<l 



> sup [[^,Du] 

£ec(mnx2 Jn 



5ec(n)nx2 J n 

ieioo<i 

In the second inequahty, the fact that / ^ ■ Du = / Du] comes from 

Jn Jn 

Proposition 2.3 of [3]. Let us also note that in the original Proposition 1.47 
cited above, the supremum is taken over functions in Cc(fi) but a quick look 
to the proof shows that it can be enlarge to functions whose support is not 
compact. 

We now want to show that for every ^ in with |^|oo < 1, there exists 

a sequence in H C(f2) with |.^n|oo < 1 such that / [^n, Du] tends to 

Jn 



/ Du], which would end the proof. 
Jn 



By Lemma 2.2 and Proposition 2.1 of [3], for every ^ G with |^|oo < 1, 
we can find ^„ G nC{Q) with |^n|oo < 1 and [C,n,Du] tending to [^,Du] 
in the sense of weak convergence of measures. 

The final step is now very similar to the proof of Theorem 4.2 of |3]. 

Let e > be given . There exists a number 6 = 6{e) > such that if we 
let = {x G O I dist{x, > 5} 

\Du\ < e 

'n\ns 

Take r] a function of Cc(fi) with rj = 1 on and |?7|oo < 1, then 



/ l^n, Du] - [ [^,Du] 
Jn Jn 



/ [^n,Du]7]- / [^,DU]7] 

'n Jn 



[a,Dn](l-r/)- / [e,Dn](l-r/) 
n Jn 
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The first term in brackets goes to zero because of tlie weak convergence of 
l^n, Du] to Du]. The second term can be bounded by 



2|e„,|oo / |Dn| + 2|e|oo / \Du\ <Ae 
Jn\ns Jn\ns 

This shows the desired result. □ 

The next proposition gives a characterization of the minimizers of the 
functional J. 

Proposition 3.6. Let J{u) = / \Du\ + G{u) + / |u — y?! then u is a 
minimizer of J in BV^ if and only if there exists ^ e X'^ such that 



div(0 G dG{u) 

[ \Du\= [ [^,Du] 
Jn Jn 



C, ■ u = in dQ^ o-nd ■ v) E sign{ip — u) in dQ^ 

We do not give the proof of this proposition here since it can be either 
found in Andreu and al. [2] p. 143 or derived more directly using the tech- 
niques we used in Proposition 13.71 and Proposition 13.81 

With these few propositions in mind we can turn back to the analysis of 
the Primal-Dual method. As noticed in the introduction, finding a minimizer 
of J is equivalent to finding a saddle point of 



Jn Jann 
The saddle function K does not fulfill the assumptions of Theorem 12.111 
since it is not Isc in u. However staying in the spirit of Lemma [2.12[ we set 



H{u,C)= sup {^,C) + K{u,0 

l?|oo<l 



sup (e,r)+ / [Du,^] + G{u)+ ! 



U — ifl 



l5|oo<l 



Du + C\+G{u) + \u-ip\ 
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Where the last equahty is obtained as in Proposition [331 The function H 
is then a convex Isc function on x [LP'Y hence OH is maximal monotone. 
We are now able to define a maximal monotone operator T by 

T{u,i) = {{u\C)/{u\i)edH{u,C)} 

In order to compute OH , which gives the expression of T, we use the 
characterization of the subdifferential 

[u\ e dH{u, C) ^ {u\ u) + (r, = H{u, C) + H*{u*, 

A first step is thus to determine what H* is. 
Proposition 3.7. We have 

D{H*) = {{u*,0/u* e L'^i^) and^ e X\ ^-u = m O^n , I^U < l} 
and 

H*{u%0 = G*{u* + dw{0)- [ i^-iyW. 

Proof. We start by computing the domain of H*. 

If (u*,^) G D{H*) then there exists a constant C such that for every 

{u*,u) + {C,0-Hiu,C)<C 
Restraining to u ^ H^{Q) with u\ =0 and ^* G {L'^Y^ we find that 

{u\u) + {C,i)- I |Vn + r|-G(n)<C 

from which 

(Vn + r, - (Vn, + - / I Vn + ri - G{u) < C 

Setting ^' = Vn + ^* and taking the supremum over all ^' G {L'^Y we 
have that |,^|oo < 1 and for all u G H^(Q) with ui = , 

-{Vu,0 + {u*,u)<C + G{u) 
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Taking now u = \u with A positive and reminding the form of G, it can 
be shown letting A tending to infinity, that for every u G with u\ = 0, 

-{Vu,0 + {u*,u) <C\u\2 

This imphes that u* + div^ G L"^ hence div^ G L^. Then by Green's 
formula in if^(div) (see Dautray-Lions [13] p. 205) we have ^ ■ z/ = in dQj^j. 

Let us now compute H*. 
Let G ^(^*), 

H*{u*,^)= sup sup + - / l/^n + ri-^H- / \u - ^ 

Let ^* G be fixed. Then by Lemma 5.2 p. 316 of Anzellotti's paper [3], 
for every m G -BV^^ there exists m„ G fl such that 



lJ2 

^ / \Du+c\ 

Jn 

We can thus restrict the supremum to functions u of class C°°[Q). We 
then have 



H*iu*,0= sup sup {{u*,u) + {C,0- ! \Du + C\-G{u)- [ 

= sup \ {u*,u) - {Vu,^) - G{u) - \u-ip\\ 
MeBy2nc°° L Jdno ) 

= sup \{u*,u)- [Du,^]-G{u)- l^^-V^I^ 

u&BV^ L "'f^ JdUD J 

= sup < (m, M* + div^) — — / {\u — (fl + ■ iy)u} > 

Beware that m G BV'^ fl C°° implies that Vm G and not Vm G 
but the density of in allows us to pass from the first equality to the 
second. The third equality follows from Lemma 1.8 of |3]. We now have to 



\u — (p\ 
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show that we can take separately the supremum in the interior of f2 and on 
the boundary dQo- 

Let / be in L^{dil) and v be in L^(f2). We want to find G BV"^ con- 
verging to V in and such that {ue)\ = f. 

By Lemma 5.5 of j3] there is a ili^ G W^'^ with {w^)\ = f and |u'e|2 < s. 

I D 

By density of C^{^) in we can find G C^(f^) with \vs — v\2<e We can 
then take = + w^- 

This shows that 

H*{u*,^)= sup {(u,u* + divO-G(u)}- inf / {|n - (^| + • z/)u} 



G*K + div(0)- / (e-i^V 



□ 

We can now compute T 

Proposition 3.8. Let {u,^) G BV"^ x i/ien, (u*,^*) G T{u,^) if and only 
if 

u* + div(0 G 

/ If + DM| = (f,0+ / [^,Du] 
Jn Jn 

■ u = in dQjsf and (f z/) G sign{(p — u) in dQo 
Proof. Let us first note that, 

G{u) + G*{u* + div(O) > {u, u* + div(O) (5) 

I \Du + C\ > [ [^,Du]+ [ re (6) 
Jn Jn Jn 

\u - ip\ > ■ iy){ip - u) (7) 
where the second inequahty is obtained arguing as in Proposition 13.51 
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By definition, (u*,^*) G T{u,^) if and only if 

{u,u*) + {^,C) = H{u,C) + H*{u*,0 



\Du + C\+G{u) + \u-ip\ 
+ G*{u* + dw{0)- [ i^-u)^ 

JdVlo 

Tliis shows tliat ([5]), ([6]) and ([7]) must be equalities which is exactly 
'u* + div(0 G dG{u) 

< [ \C + Du\ = {C,0+ I [i.Du] 
Jn Jn 

■ z^) G sign{ip — u) in dVL^ 
Moreover, ^ ■ i/ = in dVLjsi because ^ -O(^)- 1^ 

Remark . 

• The condition ■ z/) G sign{(p — u) in dQ^ is equivalent to 

/ \u — (p\ + ■ v)u = inf / \'V ~ ^\ + {i ■ i^)v 

Jdilo '" JdnD 

because inequality ^ holds true for every v and is an equality for u. 

• Whenever it has a meaning, it can he shown that the condition 



\C + Du\ = {i\i)+ / [i.Du] 
n Jn 

is equivalent to 

e + Du e diBioMO 

so that we will not distinguish between these two notations. 

This analysis shows why the constraint n G [0, 1] is hard to deal with. 
In fact, it imposes that div(,^) is a measure but not necessarily a LF' 
function. It is not easy to give a meaning to Du ■ ^ or to ■ u) on 
the boundary for such functions . However, when dealing with numerical 
implementations, it is better to keep the constraint on u. 
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We can summarize those results in the following theorem which says that 
the Primal-Dual Method is well-posed. 

Theorem 3.9. For all {uq,^o) G dom(T), there exists a unique {u{t),C,{t)) 
such that 

dtu e div(0 -<9G(m) 
dt^eDu-dlBio,i){0 

(8) 

■ v) E sign{(f — u) in dQo ^ ■ = in OQn 

(M(o),e(o)) = K,eo) 

Moreover, the energy + l^^li ^■^ ^^'^ increasing and if (u,^) is a 

saddle point of K, \u — uW + |^ — is also non increasing. 

Proof. The operator T is maximal monotone hence Theorem 12.51 applies and 
gives the result. □ 

Remark . This theorem also shows that whenever J has a minimizer, K has 
saddle points. This is because stationnary points of the system ^ are mini- 
mizers of J (verifying the Euler- Lagrange equation for J, remind Proposition 

For the Rudin-Osher-Fatemi model, one can show that there is conver- 
gence of u to the minimizer of the functional J and obtain a posteriori esti- 
mates. 

Proposition 3.10. Let G = — f {u — f'Y and dVljj = 0. Then if u is the 

2 Jn 

minimizer of J, every solution of ^ converges in to u. Furthermore, 



Proof. Let ("U, ^) be such that G T{u,C,)- Let e(t) = \u{t) — u\\ and 
g{t) = \^{t) - We show that 

\{e + gy<-\e (9) 
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Indeed, by definition of tlie flow, 

/ Du] - {i, dtO > [ Du] - dtO and 
Jn Jn 

[ [e, Du] - (e, dtO > [ [e, Du] - (e, d,i) 

Jn Jn 
Summing tliese two we find, 

/" [e - 1 D{u - u)] > - e, dt^ - dtO 

Jn 

We thus have 

^(e + g)' ={u-u, dtu - dtu) + - I d^i - d,i) 

< (n-n,div(e-0-A(n-n))+ / [^-lD{u-u)] 

Jn 

= -Xe 

The functions e and g are Lipschitz continuous. Let L be the Lipschitz 
constant of e and let h = e + g. 

Let us show by contradiction that e tends to zero when t tends to infinity. 

Suppose that there exists a > and T > such that e > a for all t > T, 
then we would have h' < —Xa and h would tend to minus infinity which is 
impossible by positivity of h. Hence 

Va > VT > 3t > T e(t) < a 

Suppose now the existence of e > such that for all T > there exists 
t > T with e(t) > e. 

By continuity of e, there exists a sequence (tn)n6N with lim tn = +oo such 

n—^+oo 

that ^ 

e{t2n) = 2 e(t2n+i) = £ 

Moreover, on [t2n-i;^2n]) we have e{t) > |. We then find that 

|e(t2n) - e(t2n-l)| < L{t2n " t2n-l) SO 

e 

771^ < t2n — ^2n-l 
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From which we see that, 

h(t2n+2) = h{t2n+l) + / k' {t) dt 

•J t2n + l 

< h{t2n+l) — S^{t2n+2 — ^2n+l) 

This shows that hm eit) = 0. 
We now prove the a posteriori error estimate. 
We have that 

u = f + ^(div^ - dtu) 
M = / + i div ^ 

Which leads to 

\^ - '^ll = ^(div(^ - - dtU, u-u) 

= J [(div(^ -^),u-u) - {dtU, u - u)\ 
= i [-(^ - I, Du - Du) - {dtu, u - u)] 

<Y j \Du\- I [^,Du] + \dtu\2\u-u\2 
^ Un Jn 

Where the last inequality follows from / Du] < / | Du \ and 

Jn Jn 



Du= / \Du\ > 0. 
Jn 

Studying the inequality < ^ + BX, we can deduce that 



19 



The estimate follows from the fact that 



-dt^ + Du\= / [e, Du] - / dt^-^ thus 
n Jn Jn 

[ \Du\ - [ \dt^\ < [ [^,Du] - [ dt^-^ hence 
Jn Jn Jn Jn 

[ \Du\ - [ [^,Du] < 2 [ \dt^\ < 2101^19*^12 
Jn Jn Jn 



□ 



Following the same lines, we can show a posteriori error estimates for 
general finite difference scheme. Indeed if V'* is any discretization of the 
gradient and if div'' is defined as — (V'*)*, the associated algorithm is 

'C = Pb(o i)(C + ^r^V'^n"-!) 

(10) 

= + 6r{div^C - A(u""i - /)) 

Where PB(oi){C,)i j = — r is the componentwise projection of C, on 

max(|^ij|,l) 

the unit ball. This algorithm is exactly the one proposed by Chan and Zhu 
in [20]. We can associate to this system a discrete energy, 

The algorithm ( JTOj) could have been directly derived from this discrete 
energy using the method of Chan and Zhu |20] (which is just the discrete 
counterpart of our continuous method). Hence, the next proposition gives a 
stopping criterion for their algorithm. 

Proposition 3.11. Let N x M be the size of the discretization grid and u 
he the minimizer of Jh then 



^n+l tn+1 fn 

Where d.u^ = and d,C = 

20 



2 



The proof of this discrete estimate is almost the same as for the continu- 
ous one. We give it in the appendix. 



Remark . In opposition to the continuous framework where we were able 
to prove a convergence result, no fully satisfactory statement is known in 
the discrete framework. For some partial results we refer to Esser and al. 
JTBj and to Chambolle and Pock fTl^ . These works mainly focus on slight 
modifications of the Primal-Dual algorithm [T^) but they also show that in 
some restricted cases the algorithm of Chan and Zhu converges. 

For the general problem, there is no uniqueness for the minimizer (for 
example in the segmentation problem) and hence convergence may not occur 
or be hard to prove. Indeed, even when uniqueness holds, we can have non 
vanishing oscillations. For example in the simpler one dimensional problem 



mm / \u'\ 



u&BVi[0,l]) Jq 

the unique minimizer is u = but u{t, x) = | cos(7ra;) sin(7rt) and 
^{t,x) = I sin(7rx) cos(7rt) gives a solution to the associated PDF system 
which does not converge to a saddle point. In this example, the energy 
is constant hence not converging to zero. We can however show general a 
posteriori estimates for the energy. 

Proposition 3.12. For every saddle point {u,C,) and every (uo,Co); the so- 
lution {u{t),^{t)) of ^ satisfies 

I J(n) - J{u)\ < (^y/|no-n|2 + |eo-eli) l^t^b + 211^1^19^^12 

Proof. Let ("U, ^) be a saddle point and {u(t),$^(t)) be a solution of ([8]). 

J{u)-J{u) = / \Du\+ / \u-ip\- / \Du\- I \u-Lp\+G{u)-G{u) 

By definition of the operator T we have 

/ [^,Du]- [ dt^-^= [ \Du-dt^\ 
Jn Jn Jn 

> [ \Du\ - [ \dt^\ 
Jo. Jn 
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This shows that 



[ \Du\< [ [^,Du] + 2 [ \dt^\ (11) 
Jn Jn Jn 



On the other hand, 

{{^■iy)u+ \u-ip\} 



[^,Du\+ \u-ip\ = - udiv^ + 
Jn Jdno Jn JdQD 



Applying / {{^ ■ i')u + \u — (p\} = inf / {{^ ■ i')v + \v — (p\} (remem- 

Jdno Jdno 

ber the Remarks after Proposition 13. 8p to i; = n we have 

[^,Du]+ \u-ip\- \u-^\<- udiv^+ {^■i^)u 
n Jd^o JdQ.D J^ Jdno 

= - / Mdiv^+ / Mdiv^+ / [^,Du\ 
Jn Jn Jn 

= [ {u-u)diY^+ [ [^,Du] 
Jn Jn 

This and ( ITT]) show that 

J{u)-J{u) < [{u-u)dw^+ [ [^,Du] + 2 I \dti\ - [ \Du\ + Giu)-Giu) 
Jn Jn Jn Jn 

If we now use the definition of the subgradient to get 

G{u) - G{u) < (div(0 - dtu, u-u) 
we find with Cauchy-Schwarz's inequahty, 

J{u)- J{u)<2\n\^dti\2+ I {u-u)dtu+ [ [^,Du]- [ \Du\ 

Jn Jn Jn 

<2\Q\-2\dt^\2 + \u-u\2\dtu\2 



Which gives the estimate reminding that y^\u — u\l + |^ — is non in- 
creasing. □ 
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Remark . 

Supported by numerical evidence, we can conjecture that whenever the con- 
straint on is saturated somewhere, convergence of u occurs. It might how- 
ever he also necessary to add the constraint u E [0, 1] in order to have this 
convergence. 

Considering a finite difference scheme, just as for tlie Rudin-Osher-Fatemi 
model, we can define a discrete energy Jh and show the corresponding a 
posteriori estimate. 

Proposition 3.13. If u is a minimizer of Jh and (m", is defined by 

withp"" e then 

VhW - Jh{u)\ < 2VN X M\dtC\ + l^tM^IlM"-^ -m| 
We omit the proof because it is exactly the same as for Proposition 13.121 
Remark . 

• The boundary conditions are hidden here in the operator V^. 

• In the discrete framework, the estimate involves \u"' — u\ which can not 
be easily bounded by the initial error. 



4 Numerical Experiments 

To illustrate the relevance of our a posteriori estimates, we first consider the 
simple example of denoising a rectangle (see Figure [3]). We then compare the 
a posteriori error bound with the "true" error. We use the relative error 

defined as — — — and ran the algorithm of Chan and Zhu with A = 0.005 

\u\ 

and fixed time steps verifying X5t = 1 and 5r = ^. With this choice of 
parameters convergence is guaranteed by the work of Esser and al. [15]. The 
minimizer u is computed by the algorithm after 50000 iterations. Figure H] 
shows that the a posteriori bound is quite sharp. 
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Figure 3: Denoising of a rectangle using the ROF model 



«;F. 

a posteriori error 




reai error 



I 1 , 1 I I ^ ^_ 1 

1000 ZOOO 3000 4000 5000 6000 7000 0000 0000 10000 
iterations 



Figure 4: Comparison of the relative error with the predicted a posteriori 
bound. 

The second experiment is performed on the yeast segmentation of Figure 
|2l The solution was computed with the algorithm of Chan and Zhu using 
as weight function g the one proposed by Appleton and Talbot We used 
this time the error \Jh{u"') — Jh{u)\ and ran the algorithm with 6t = 0.2 and 
6t = 0.2. For this problem there is no proof of convergence of the algorithm. 
The minimizer u is computed by the algorithm after 50000 iterations. We 
can see on Figure |5] that for this problem, the a posteriori estimate is not so 
sharp. We must also notice that in general we do not know u. 

In the last numerical example, we compare the results obtained by the 
algorithm of Appleton and Talbot (see with those obtained by a classical 
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" 1 000 ZOOO 3000 4000 5000 0000 7000 0000 9000 lOOOt 
iterations 

Figure 5: Comparison for the segmentation problem. 

discretization of the total variation. In Figure El we can see the denoising of 
a disk with these two methods for A = 0.003. We used the algorithm of Chan 
and Zhu to compute the minimization of the discrete total variation. 
Looking at the top right corner (see Figure [7]), we can see that the result is 
more accurate and less anisotropical for the algorithm of Appleton and Talbot 
than for the scheme of Chan and Zhu. These results are to be compared with 
those obtained by ChamboUe and al. for the so-called "upwind" discrete BV 
norm in |10| . 




Figure 6: Denoising of a disk using the algorithm of Appleton- Talbot (left) 
and Chan- Zhu (right) 
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Figure 7: Top right corner of the denoised disk, Appleton- Talbot (left) and 
Chan-Zhu (right) 

5 Conclusion 

In this article we have shown the well posedness of the continuous Primal- 
Dual method proposed by Appleton and Talbot for solving problems arising 
in imaging. We have also proved for the ROF model, that in the continuous 
setting there is convergence towards the minimizer. We then derived some 
a posteriori estimates. Numerical experiments have illustrated that if these 
estimates are quiet sharp for the ROF model, they should be improved for 
applications to other problems. 

The continuous framework leaves the way open to a wide variety of numerical 
schemes, ranging from finite differences to finite volumes. Indeed, by design- 
ing algorithms solving the system of PDEs (j8]) one can expect to find accurate 
algorithms for computing solutions of variational problems involving a total 
variation term. 



A Proof of Proposition 13.11 



For notational convenience, we present the proof for A = 1. Let u be the 
minimizer of then there exists C, such that |.^|oo < 1 and 



u 
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Reminding that = f + div ^""'"^ — dtU^ we get 
|u" - up = (div''({"+^ - - 5t^^", - u) 

We have that = Pb(o,i)('C" + 5T'"+^V'*n") hence by definition of the 
projection, 

G 5(0, 1) iC^' - {C + 5r"+V^u"), ^ - r^^) > 
This gives us 

(vv,e-r+')<(5*r,e-n 

Combining this with {dtC, - (dtC, D < 2ViV x M|9j^"| (which holds by 
Cauchy-Schwarz's inequahty, |^|oo < 1 and l^^loo < 1), we find that 

The announced inequahty easily follows. 
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